High and Low Temperatures 


Identification 


1. Indicator Description 

This indicator examines metrics related to trends in unusually hot and cold temperatures across the 
United States over the last several decades. Changes in many extreme weather and climate events have 
been observed, and further changes, such as fewer cold days and nights and more frequent hot days 
and nights, are likely to continue this century (IPCC, 2013). Extreme temperature events like summer 
heat waves and winter cold spells can have profound effects on human health and society. 

Components of this indicator include: 


• An index reflecting the frequency of extreme heat events (Figure 1). 

• The percentage of land area experiencing unusually hot summer temperatures or unusually cold 
winter temperatures (Figures 2 and 3, respectively). 

• Changes in the prevalence of unusually hot and unusually cold temperatures throughout the 
year at individual weather stations (Figures 4 and 5). 

• The proportion of record-setting high temperatures to record low temperatures over time 
(Figure 6). 


2. Revision History 


April 2010: 
December 2012: 


August 2013: 
May 2014: 

June 2015: 
August 2016: 


Indicator published. 

Combined original Figures 2 and 3 into new Figure 2. Updated Figure 1 with data 
through 2011, and updated Figure 2 with data through 2012. Added Figure 3 and 
Figure 4 to show to show unusually cold winter temperatures and record daily highs 
and lows, respectively. 

Updated Figure 1 on EPA's website with data through 2012; updated Figure 3 on 
EPA's website with data through 2013. 

Added Figures 4 and 5 and renumbered "Record Daily Highs and Record Daily Lows" 
to Figure 6. Updated Figures 1 and 2 with data through 2013; updated Figure 3 with 
data through 2014. 

Updated Figures 1, 2, 4, and 5 on EPA's website with data through 2014; updated 
Figure 3 on EPA's website with data through 2015. 

Updated Figures 1, 2, 4, and 5 with data through 2015; updated Figure 3 with data 
through 2016. 
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Data Sources 


3. Data Sources 

Index values for Figure 1 were provided by Dr. Kenneth Kunkel of the National Oceanic and Atmospheric 
Administration's (NOAA's) Cooperative Institute for Climate and Satellites (CICS), who updated an 
analysis that was previously published in U.S. Climate Change Science Program (2008). Data for Figures 2 
and 3 come from NOAA's U.S. Climate Extremes Index (CEI), which is maintained by NOAA's National 
Centers for Environmental Information (NCEI) and based on a specific quality-controlled subset of long- 
term stations that NCEI has designated as its U.S. Historical Climatology Network (USFICN) dataset 
( www.ncdc.noaa.gov/extremes/cei/data-used ). Data for Figures 4 and 5 come from U.S. weather 
stations within NCEI's Global Historical Climatology Network, Daily edition (G HCN-Daily). Data for Figure 
6 come from an analysis published by Meehl et al. (2009). 

All components of this indicator are based on temperature measurements from weather stations 
overseen by NOAA's National Weather Service (NWS). These underlying data are maintained by NCEI. 

4. Data Availability 

Figure 1. U.S. Annual Heat Wave Index , 1895-2015 

Data for this figure were provided by Dr. Kenneth Kunkel of NOAA CICS, who performed the analysis 
based on data from NCEI's publicly available databases. 

Figures 2 and 3. Area of the Contiguous 48 States with Unusually Hot Summer Temperatures (1910- 
2015) or Unusually Cold Winter Temperatures (1911-2016) 

NOAA has calculated each of the components of the CEI and has made these data files publicly available. 
The data for unusually hot summer maximum and minimum temperatures (CEI steps lb and 2b) and for 
unusually cold winter maximum and minimum temperatures (CEI steps la and 2a) can be downloaded 
from: www.ncdc.noaa.gov/extremes/cei/graph . NOAA's CEI website ( www.ncdc.noaa.gov/extremes/cei) 
provides additional descriptions and links, along with a portal to download or graph various components 
of the CEI, including the data sets listed above. 

Figures 4 and 5. Changes in Unusually Hot and Cold Temperatures in the Contiguous 48 States, 1948- 
2015 

Data for these maps came from Version 3.22 of NCEI's GFICN-Daily data set, which provided the optimal 
format for processing. Within the contiguous 48 states, the GFICN pulls data directly from a dozen 
separate data sets maintained at NCEI. NCEI explains the variety of databases that feed into the GFICN 
for U.S. -based stations in online metadata and at: www.ncdc.noaa.gov/oa/climate/ghcn- 
daily/index.php?name=source . The data for this indicator can be obtained online via FTP at: 
ftp://ftp.ncdc.noaa.gov/pub/data/ghcn/daily/hcn . Appropriate metadata and "readme" files are 
available at: ftp://ftp.ncdc.noaa.gov/pub/data/ghcn/daily . 
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Figure 6. Record Daily High and Low Temperatures in the Contiguous 48 States, 1950-2009 


Ratios of record highs to lows were taken from Meehl et al. (2009) and a supplemental release that 
accompanied the publication of that peer-reviewed study 

(www2.ucar.edu/atmosnews/news/1036/record-high-temperatures-far-outpace-record-lows-across- 

us). Meehl et al. (2009) covered the period 1950-2006, so the "2000s" bar in Figure 6 is based on a 
subsequent analysis of data through 2009 that was conducted by the authors of the paper and 
presented in the aforementioned press release. For confirmation, EPA obtained the actual counts of 
highs and lows by decade from Claudia Tebaldi, a co-author of the Meehl et al. (2009) study. 

Underlying Data 

NCEI maintains a set of databases that provide public access to daily and monthly temperature records 
from thousands of weather stations across the country. For access to these data, see NCEI's website at: 
www.ncdc.noaa.gov . There are no confidentiality issues that may limit accessibility. For an inventory of 
stations and station metadata, see: www.ncdc.noaa.gov/data-access/land-based-station-data . 


Methodology 


5. Data Collection 

Since systematic collection of weather data in the United States began in the 1800s, observations have 
been recorded from 23,000 stations. At any given time, approximately 8,000 stations are recording 
observations on an hourly basis, along with the maximum and minimum temperatures for each day. 
Some of these stations are automated stations operated by NOAA's National Weather Service. The 
remainder are Cooperative Observer Program (COOP) stations operated by other organizations using 
trained observers and equipment and procedures prescribed by NOAA. For an inventory of U.S. weather 
stations and information about data collection methods, see: www.ncdc.noaa.gov/data-access/land- 
based station-data, the technical reports and peer-reviewed papers cited therein, and the National 
Weather Service technical manuals at: www.nws.noaa.gov/om/coop/training.htm . Sampling procedures 
are also described in Kunkel et al. (2005) and in the full metadata for the COOP data set, available at: 
www.nws.noaa.gov/om/coop . Variables that are relevant to this indicator include observations of daily 
maximum and minimum temperatures. 

All six figures use data from the contiguous 48 states. Original sources and selection criteria are as 
follows: 

• Figure 1 is based on stations from the COOP data set that had sufficient data during the period 
of record (1895-2015). 

• Figures 2 and 3 are based on a narrower set of stations that NOAA has designated as part of the 
USFICN. The USFICN is a subset of COOP and automated weather stations that meet certain 
selection criteria for record longevity, data availability, spatial coverage, and consistency of 
location. They also undergo additional levels of quality control. The period of record varies for 
each station, but generally includes most of the 20 th century. Additional selection criteria were 
applied to these data prior to inclusion in CEI calculations, as described by Gleason et al. (2008). 
In compiling the temperature components of the CEI, NOAA selected only those stations with 
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monthly temperature data at least 90-percent complete within a given period (e.g., annual, 
seasonal) as well as 90-percent complete for the full period of record. 

• Figures 4 and 5 use daily maximum and minimum temperature data from GHCN-Daily Version 
3.22. GHCN-Daily contains historical daily weather data from thousands of monitoring stations 
across the United States. This analysis is limited to the period from 1948 to 2015 because it 
enabled inclusion of most stations from the USHCN, which is a key contributing database to the 
GHCN-Daily. Station data are included only for years in which data are reported (one or more 
days) in six or more months. If a station reported data from fewer than six months, data from 
the entire year are removed. After filtering for individual years (above), stations are removed 
from further consideration if fewer than 48 years of data are included. Years need not be 
consecutive. As a result, Figures 4 and 5 show trends for 1,100 stations. 

• In Figure 6, data for the 1950s through 1990s are based on a subset of 2,000 COOP stations that 
have collected data since 1950 and had no more than 10 percent missing values during the 
period from 1950 to 2006. These selection criteria are further described in Meehl et al. (2009). 

• In Figure 6, data for the 2000s are based on the complete set of COOP records available from 
2000 through September 2009. These numbers were published in Meehl et al. (2009) and the 
accompanying press release, but they do not follow the same selection criteria as the previous 
decades (as described above). Counts of record highs and lows using the Meehl et al. (2009) 
selection criteria were available, but only through 2006. Thus, to make this indicator as current 
as possible, EPA chose to use data from the broader set that extends through September 2009. 
Using the 2000-2006 data would result in a high:low ratio of 1.86, compared with a ratio of 2.04 
when the full-decade data set (shown in Figure 6) is considered. 

6. Indicator Derivation 

Figure 1. U.S. Annual Heat Wave Index , 1895-2015 

Data from the COOP data set have been used to calculate annual values for a U.S. Annual Heat Wave 
Index. In this indicator, heat waves are defined as warm periods of at least four days with an average 
temperature (that is, averaged over all four days) exceeding the threshold for a one-in-10-year 
occurrence (Kunkel et al., 1999). The Annual U.S. Heat Wave Index is a frequency measure of the 
number of heat waves that occur each year. A complete explanation of trend analysis in the annual 
average heat wave index values, especially trends occurring since 1960, can be found in Appendix A, 
Example 2, of U.S. Climate Change Science Program (2008). Analytical procedures are described in 
Kunkel et al. (1999). 

Figures 2 and 3. Area of the Contiguous 48 States with Unusually Hot Summer Temperatures (1910- 
2015) or Unusually Cold Winter Temperatures (1911-2016) 

Figure 2 of this indicator shows the percentage of the area of the contiguous 48 states in any given year 
that experienced unusually warm maximum and minimum summer temperatures. Figure 3 displays the 
percentage of land area that experienced unusually cold maximum and minimum winter temperatures. 

Figures 2 and 3 were developed as subsets of NOAA's CEI, an index that uses six variables to examine 
trends in extreme weather and climate. These figures are based on components of NOAA's CEI (labeled 
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as Steps la, lb, 2a, and 2b) that look at the percentage of land area within the contiguous 48 states that 
experienced maximum (Step 1) or minimum (Step 2) temperatures much below (a) or above (b) normal. 

NOAA computed the data for the CEI and calculated the percentage of land area for each year by 
dividing the contiguous 48 states into a 1-degree by 1-degree grid and using data from one station per 
grid box. This was done to eliminate many of the artificial extremes that resulted from a changing 
number of available stations over time. 

NOAA began by averaging all daily highs at a given station over the course of a month to derive a 
monthly average high, then performing the same step with daily lows. Next, period (monthly) averages 
were sorted and ranked, and values were identified as "unusually warm" if they fell in the highest 10 th 
percentile in the period of record for each station or grid cell, and "unusually cold" if they fell in the 
lowest 10 th percentile. Thus, the CEI has been constructed to have an expected value of 10 percent for 
each of these components, based on the historical record— or a value of 20 percent if the two extreme 
ends of the distribution are added together. 

The CEI can be calculated for individual months, seasons, or an entire year. Figure 2 displays data for 
summer, which the CEI defines as June, July, and August. Figure 3 displays data for winter, which the CEI 
defines as December, January, and February. Winter values are plotted at the year in which the season 
ended; for example, the winter from December 2015 to February 2016 is plotted at year 2016. This 
explains why Figures 2 and 3 appear to have a different starting year, as data were not available from 
December 1909 to calculate a winter value for 1910. To smooth out some of the year-to-year variability, 
EPA applied a nine-point binomial filter, which is plotted at the center of each nine-year window. For 
example, the smoothed value from 2007 to 2015 is plotted at year 2011. NOAA NCEI recommends this 
approach and has used it in the official online reporting tool for the CEI. 

EPA used endpoint padding to extend the nine-year smoothed lines all the way to the ends of the period 
of record. As recommended by NCEI, EPA calculated smoothed values as follows: if 2015 was the most 
recent year with data available, EPA calculated smoothed values to be centered at 2012, 2013, 2014, 
and 2015 by inserting the 2015 data point into the equation in place of the as-yet-unreported annual 
data points for 2016 and beyond. EPA used an equivalent approach at the beginning of the time series. 

The CEI has been extensively documented and refined over time to provide the best possible 
representation of trends in extreme weather and climate. For an overview of how NOAA constructed 
Steps 1 and 2 of the CEI, see: www.ncdc.noaa.gov/extremes/cei . This page provides a list of references 
that describe analytical methods in greater detail. In particular, see Gleason et al. (2008). 

Figures 4 and 5. Changes in Unusually Hot and Cold Temperatures in the Contiguous 48 States, 1948- 
2015 

For Figure 4, the change in the number of days per year on which the daily maximum temperature 
exceeded the 95 th percentile temperature was determined through the following steps: 

1. At each monitoring station, the 95 th percentile daily maximum temperature was determined for 
the full period of record (1948-2015). 

2. For each station, the number of days in each calendar year on which the maximum daily 
temperature exceeded the station-specific 95 th percentile temperature was determined. 
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3. The average rate of change over time in the number of >95 th percentile days was estimated 
from the annual number of >95 th percentile days using ordinary least-squares linear regression. 

4. Regression coefficients (the average change per year in >95 th percentile days) for regressions 
significant at the 90-percent level (p < 0.1) were multiplied by the number of years in the 
analysis (1948-2015 = 67 years) to estimate the total change in the number of annual >95 th 
percentile days over the full period of record. Where p > 0.1, coefficients were set to zero. These 
values (including "zero" values for stations with insignificant trends) were mapped to show 
trends at each climate station. 

Figure 5 was constructed using a similar procedure with daily minimum temperatures and the 5 th 
percentile. 

Figure 6. Record Daily High and Low Temperatures in the Contiguous 48 States, 1950-2009 

Figure 6 displays the proportion of daily record high and daily record low temperatures reported at a 
subset of quality-controlled NCEI COOP network stations (except for the most recent decade, which is 
based on the entire COOP network, as described in Section 5). As described in Meehl et al. (2009), steps 
were taken to fill missing data points with simple averages from neighboring days with reported values 
when there are no more than two consecutive days missing, or otherwise by interpolating values at the 
closest surrounding stations. 

Based on the total number of record highs and the total number of record lows set in each decade, 
Meehl et al. (2009) calculated each decade's ratio of record highs to record lows. EPA converted these 
values to percentages to make the results easier to communicate. 

Although it might be interesting to look at trends in the absolute number of record highs and record 
lows over time, these values are recorded in a way that would make a trend analysis misleading. A daily 
high or low is registered as a "record" if it broke a record at the time— even if that record has since been 
surpassed. Statistics dictate that as more years go by, it becomes less likely that a record will be broken. 
In contrast, if a station has only been measuring temperature for 5 years (for example), every day has a 
much greater chance of breaking a previous record. Thus, a decreasing trend in absolute counts does 
not indicate that the climate is actually becoming less extreme, as one might initially guess. Meehl et al. 
(2009) show that actual counts indeed fit a decreasing pattern over time, as expected statistically. 

7. Quality Assurance and Quality Control 

The NWS has documented COOP methods, including training manuals and maintenance of equipment, 
at: www.nws.noaa.gov/os/coop/training.htm . These training materials also discuss quality control of the 
underlying data set. Additionally, pre-1948 data in the COOP data set have recently been digitized from 
hard copies. Quality control procedures associated with digitization and other potential sources of error 
are discussed in Kunkel et al. (2005). 

Data from weather stations go through a variety of additional quality assurance and quality control 
(QA/QC) procedures before they can be added to historical datasets such as the USFICN and GFICN. 
Procedures that were used to address specific potential problems in trend estimation in the most recent 
version of the USFICN are summarized at: www.ncdc.noaa.gov/oa/climate/research/ushcn/#processing . 
Flomogeneity testing and data correction methods are described in numerous peer-reviewed scientific 
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papers by NCEI. A series of data corrections was developed to specifically address potential problems in 
trend estimation of the rates of warming or cooling in USHCN Version 2 and beyond. They include: 

• Removal of duplicate records. 

• Procedures to deal with missing data. 

• Adjusting for changes in observing practices, such as changes in observation time. 

• Testing and correcting for artificial discontinuities in a local station record, which might reflect 
station relocation, instrumentation changes, or urbanization (e.g., heat island effects). 

Quality control procedures for GHCN-Daily data are described at: www.ncdc.noaa.gov/oa/climate/ghcn- 
daily/index.php?name=quality . GHCN-Daily data undergo rigorous quality assurance reviews, starting 
with pre-screening for data and station appropriateness. This data integration process is described in 
detail at: www.ncdc.noaa.gov/oa/climate/ghcn-daily/index.php?name=integration . Further quality 
assurance procedures for individual data points include removal of duplicates, isolated values, 
suspicious streaks, and excessive or unnatural values; spatial comparisons that verify the accuracy of the 
climatological mean and the seasonal cycle; and neighbor checks that identify outliers from both a serial 
and a spatial perspective. Data that fail a given quality control check (0.3 percent of all values) are 
marked with flags, depending on the type of error identified. 


Analysis 


8. Comparability Over Time and Space 

Long-term weather stations have been carefully selected from the full set of all COOP stations to provide 
an accurate representation of the United States for the U.S. Annual Heat Wave Index and the proportion 
of record daily highs to record daily lows (Kunkel et al., 1999; Meehl et al., 2009). Some bias may have 
occurred as a result of changes over time in instrumentation, measuring procedures, and the exposure 
and location of the instruments. The record high/low analysis begins with 1950 data, in an effort to 
reduce disparity in station record lengths. 

The USHCN has undergone extensive testing to identify errors and biases in the data and either remove 
these stations from the time series or apply scientifically appropriate correction factors to improve the 
utility of the data. In particular, these corrections address changes in the time-of-day of observation, 
advances in instrumentation, and station location changes. Homogeneity testing and data correction 
methods are described in more than a dozen peer-reviewed scientific papers by NCEI. Data corrections 
were developed to specifically address potential problems in trend estimation of the rates of warming or 
cooling in the USHCN (see Section 7 for documentation). 

NOAA's Climate Reference Network ( www.ncdc.noaa.gov/crn) , a set of optimally-sited stations 
completed in 2008, can be used to test the accuracy of recent trends. While it is true that some stations 
are not optimally located, NOAA's findings support the results of an earlier analysis by Peterson (2006), 
who found no significant bias in long-term trends associated with station siting once NOAA's 
homogeneity adjustments were applied. An independent analysis by the Berkeley Earth Surface 
Temperature (BEST) project ( http://berkeleyearth.org/summarv-of-findings ) used more stations and a 
different statistical methodology, yet found similar results. 
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As documented in Section 7, GHCN-Daily stations are extensively filtered and quality-controlled to 
maximize comparability across stations and across time. 

9. Data Limitations 

Factors that may impact the confidence, application, or conclusions drawn from this indicator are as 
follows: 

1. Biases may have occurred as a result of changes over time in instrumentation, measuring 
procedures, and the exposure and location of the instruments. Where possible, data have been 
adjusted to account for changes in these variables. For more information on these corrections, 
see Section 7. Some scientists believe that the empirical de-biasing models used to adjust the 
data might themselves introduce non-climatic biases (e.g., Pielke et al., 2007). 

2. Observer errors, such as errors in reading instruments or writing observations on the form, are 
present in the earlier part of this data set. Additionally, uncertainty may be introduced into this 
data set when hard copies of data are digitized. As a result of these and other factors, 
uncertainties in the temperature data increase as one goes back in time, particularly because 
there were fewer stations early in the record. NOAA does not believe, however, that these 
uncertainties are sufficient to undermine the fundamental trends in the data. More information 
about limitations of pre-1948 weather data can be found in Kunkel et al. (2005). 

10. Sources of Uncertainty 

Uncertainty may be introduced into this data set when hard copies of historical data are digitized. For 
this and other reasons, uncertainties in the temperature data increase as one goes back in time, 
particularly because there are fewer stations early in the record. NOAA does not believe, however, that 
these uncertainties are sufficient to undermine the fundamental trends in the data. Vose and Menne 
(2004) suggest that the station density in the U.S. climate network is sufficient to produce robust spatial 
averages. 

Error estimates have been developed for certain segments of the data set, but do not appear to be 
available for the data set as a whole. Uncertainty measurements are not included with the publication of 
the U.S. Annual Fleat Wave Index or the CEI seasonal temperature data. Error measurements for the 
pre-1948 COOP data set are discussed in detail in Kunkel et al. (2005). 

11. Sources of Variability 

Inter-annual temperature variability results from normal year-to-year variation in weather patterns, 
multi-year climate cycles such as the El Nino-Southern Oscillation and Pacific Decadal Oscillation, and 
other factors. This indicator presents nine-year smoothed curves (Figures 1, 2, and 3), long-term rates of 
change (Figures 4 and 5), and decadal averages (Figure 6) to reduce the year-to-year "noise" inherent in 
the data. Temperature patterns also vary spatially. This indicator provides information on geographic 
differences using location-specific trends in Figures 4 and 5. 
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12. Statistical/Trend Analysis 


Heat wave trends (Figure 1) are somewhat difficult to analyze because of several outlying values in data 
from the 1930s. Statistical methods used to analyze trends in the U.S. Annual Heat Wave Index are 
presented in Appendix A, Example 2, of U.S. Climate Change Science Program (2008). Despite the 
presence of inter-annual variability and several outlying values in the 1930s, standard statistical 
treatments can be applied to assess a highly statistically significant linear trend from 1960 to 2011. 
However, the trend over the full period of record is not statistically significant. 

Figures 4 and 5 use ordinary least-squares linear regression to calculate the slope of observed trends in 
the annual number of 95 th and 5 th percentile days at each monitoring station. Trends that are not 
statistically significant at the 90 percent level (p < 0.1) are displayed as zero (i.e., they are grouped into 
the "-5 to 5" class). 

This indicator does not report on the slope of the apparent trends in Figures 2, 3, and 6, nor does it 
calculate the statistical significance of these trends. 
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